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METHOD AND SYSTEM FOR DETERMINING DROPPED FRAME RATES OVER 

A PACKET SWITCHED TRANSPORT 

Background of the Invention 

5 1. Field of the Invention 

The present invention relates generally to testing telecommunications networks, and 
particularly to detecting dropped packets over a packet switched network. 

L.i. 2. Technical Background 

y 10 New telecommunications technologies are emerging that employ packet switching 

W instead of, or in addition to, the traditional circuit-switched technologies provided by the 

45 

□ public switched telephone networks (PSTN). Providing full duplex voice over the Internet 
\ i (VoIP) is of particular importance. VoIP services are attractive to commercial long-distance 

carriers because they enable the use of global Internet transport facilities to carry traffic that 
fU 15 is presently being carried over dedicated circuit-switched facilities. The potential benefits are 

m 

\\ enormous, considering the possibilities for reduction in data exchange capacity required to 

support a telephone call, opportunities for developing new features and functions for voice 
services, and the economies of scale from the use of one kind of transport for all 
telecommunications services. However, a major impediment to the use of VoIP services is 
20 concern as to the likely user perception of the quality of full-duplex voice communications 
using VoIP. 

Telephone connections have always been subject to impairments in the form of noise, 
attenuation, distortion, cross-talk and echo. Such impairments are particularly common to 
analog portions of the network, such as subscriber loops and frequency domain multiplexing 

25 equipment. Digital transmission alleviates many of these problems but also introduces 
quantization noise and distortions due to bit errors in the digital signal. Even with perfect 
digital transmission applied to long haul transmissions, a typical telephone connection 
includes many analog components where impairments can occur. As a result, a poor 
connection or malfunctioning piece of equipment can produce unacceptably poor 

30 reproduction of voice, or conditions on a connection that customers will find objectionable or 
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intolerable. When there is a high incidence of poor connections, the customer may complain 
to the service provider or to a regulatory authority, or simply change long distance carriers. 
Thus, perceived quality Of telephone connections is a major factor affecting the reputation 
and marketability of long distance telephone services. 
5 To guard against poor quality, service providers have developed methods to obtain 

objective quality measurements for a line, piece of equipment, or an end-to-end telephone 
connection. These measurements can help the service provider detect and gauge 
impairments, pinpoint weak elements, and correct deficiencies that degrade user perception of 
quality. As a result, the average consumer has to come to expect a certain quality of service 

9 10 from the PSTN. 

O 

CO With the proliferation of voice-over-packet technologies, maintaining quality of 

Q service comparable to the PSTN is a major concern of service providers, equipment vendors, 

| : j and ultimately the consumers of telecommunications services. Unlike circuit switched traffic, 

^ real time voice transmission using packet switched technologies is sensitive to the packet 

fU 1 5 loss, packet delay, and jitter that are characteristic of packet switched networks. In 

sj particular, packet loss and packet delay variations may result in transmissions missing some 

n 

tf s packets, thereby creating an audio signal that is distorted, garbled, or otherwise degraded. 

I y 

IntServ and Diffserv protocols have been proposed for improving the reliability and 
consistency of packet transport for packets carrying voice. RTCP (Real Time Transmission 

20 Control Protocol) is being deployed to enable real-time measurements of the receipt of packet 
data, and for reporting the measurements to a sender or to a network quality monitoring 
location. However, in a hybrid network that includes both a circuit switched network, such as 
the PSTN and a packet switched network, the detection of dropped packets is problematic, 
because none of the protocol data is relayed to the end station. The problem, then, is how to 

25 measure dropped frame rates codec-to-codec across a packet switched network when there is 
no access to packet transmission control data. This problem is exacerbated by the fact that 
dropped frame rates may be manifested in two distinct ways. First, the dropped packet may 
simply be skipped. If so, the result is a null (a segment of time with no signal energy at all) 
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in the received voice signal. Alternatively, when a packet has not been received in time to 
maintain a continuous flow of voice, the receiving codec may simply insert the previous 
packet or a segment of white noise to avoid a null. This packet loss concealment routine 
results in repetition of speech waveforms or other phenomena that distort speech signals. It 
5 also has the effect of disguising the fact that a dropped packet that would have otherwise been 
revealed by a null was lost. Thus, the presence of nulls will indicate dropped packets, when 
no packet concealment routine is applied, or the number of dropped packets exceeds the 
dynamic range of the operant packet loss concealment routine. However, the dropped 
packets whose occurrence is disguised by a packet loss concealment routine will be more 
10 difficult to detect mechanically. 

What is needed is a system and method for detecting dropped packets across a packet 
switched network when there is no access to packet network transmission control data that 
reliably detects dropped packets, absent any knowledge of whether, or what kind of, a packet 
loss concealment technique is being used. 

15 

Summary of the Invention 
The present invention is directed to a system and method for detecting dropped 
packets across a packet switched network when there is no access to packed switch 
transmission control data that reliably detects dropped packets. The present invention also 
20 provides a system and method for detecting dropped packets absent any knowledge of 
whether, or what kind of, a packet loss concealment technique is being used. 
One aspect of the present invention is a method for detecting dropped packets in a network that includes 
a packet switched network. The method includes establishing a telephonic connection 
between a first network location and a second network location. At least one set of N 
25 waveforms are transmitted from the first network location. Each transmitted waveform 

includes a waveform characteristic operative to assign a predetermined value relative to other 
waveforms in the at least one set, such that a predetermined sequence of values are assigned 
to packets carrying the N transmitted waveforms. At least one telephonic signal is received at 
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the second network location via the communications channel. The at least one telephonic 
signal is processed to obtain a received sequence of values. The received sequence of values 
is compared to the predetermined sequence of transmitted values to detect dropped packets 
without having access to packet switched network control data. 
5 In another aspect, the present invention includes a system for detecting dropped 

packets in a telecommunications network including a packet switched network. The system 
includes a transmission unit configured to send at least one set of N waveforms over the 
telecommunications network. Each transmitted waveform includes a waveform characteristic 
operative to assign a predetermined value relative to other waveforms in the at least one set, 

|=4s 

q 10 such that a predetermined sequence of values are assigned to packets carrying the N 

transmitted waveforms. A receiver unit is operative to receive a telephonic signal from the 

S ^ telecommunications network. The receiver also is configured to derive a received sequence 

O 

M of values from the telephonic signal, and compare the received sequence of values to the 

y 

£5 predetermined sequence of values to detect dropped packets, without having access to packet 

«H 1 5 switched network transmission control data. 

f y 

[4 In another aspect, the present invention includes a computer-readable medium having 

Q computer-executable instructions for performing a method. The method includes 

flf 

transmitting at least one set of N waveforms from the first network location. Each transmitted 
waveform includes a waveform characteristic operative to assign a predetermined value 

20 relative to other waveforms in the at least one set, such that a predetermined sequence of 

values are assigned to packets carrying the N transmitted waveforms. At least one telephonic 
signal is received at the second network location via the communications channel. The at 
least one telephonic signal is processed to obtain a received sequence of values. The received 
sequence of values is compared to the predetermined sequence of transmitted values to detect 

25 dropped packets without having access to packet switched network control data. 

In another aspect, the present invention includes a computer-readable medium having 
computer-executable instructions for performing a method. The method includes establishing 
a telephonic connection between a first network location and a second network location. At 
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least one set of N waveforms is transmitted from the first network location. Each transmitted 
waveform includes a waveform characteristic operative to assign a predetermined value 
relative to other waveforms in the at least one set, such that a predetermined sequence of 
values are assigned to packets carrying the N transmitted waveforms. 
5 In another aspect, the present invention includes a computer-readable medium having 

computer-executable instructions for performing a method. The method includes receiving at 
least one telephonic signal from a telephonic connection. The at least one telephonic signal is 
processed to obtain a received sequence of values. The received sequence of values is 
compared to the predetermined sequence of transmitted values to detect dropped packets 

lath 

p 10 without having access to packet switched network control data. 

Additional features and advantages of the invention will be set forth in the detailed 
description which follows, and in part will be readily apparent to those skilled in the art from 



M that description or recognized by practicing the invention as described herein, including the 

U 

B detailed description which follows, the claims, as well as the appended drawings. 

15 It is to be understood that both the foregoing general description and the following 

l xvr 

ry detailed description are merely exemplary of the invention, and are intended to provide an 

SI 

p overview or framework for understanding the nature and character of the invention as it is 



fa 



claimed. The accompanying drawings are included to provide a further understanding of the 
invention, and are incorporated in and constitute a part of this specification. The drawings 
20 illustrate various embodiments of the invention, and together with the description serve to 
explain the principles and operation of the invention. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a hybrid telecommunications network in accordance 
25 with an embodiment of the present invention; 

Figure 2 is a detailed diagram of the test system for determining dropped packets 
depicted in Figure 1; and 

Figure 3 is a chart showing a method for determining dropped packets in accordance 
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with another embodiment of the present invention. 

Detailed Description 

Reference will now be made in detail to the present exemplary embodiments of the 
invention, examples of which are illustrated in the accompanying drawings. Wherever 
possible, the same reference numbers will be used throughout the drawings to refer to the 
same or like parts. An exemplary embodiment of the system of the present invention is 
shown in Figure 1 and 2, and is designated generally throughout by reference numeral 10. 

In accordance with the invention, the present invention is directed to a method for 
detecting dropped packets in a network that includes a packet switched network. The method 
includes establishing a telephonic connection between a first network location and a second 
network location. At least one set of N waveforms are transmitted from the first network 
location. Each transmitted waveform includes a waveform characteristic operative to assign a 
predetermined value relative to other waveforms in the at least one set, such that a 
predetermined sequence of values are assigned to packets carrying the N transmitted 
waveforms. At least one telephonic signal is received at the second network location via the 
communications channel. The at least one telephonic signal is processed to obtain a received 
sequence of values. The received sequence of values is compared to the predetermined 
sequence of transmitted values to detect dropped packets without having access to packet 
switched network control data. The system and method of the present invention detects 
dropped packets across a packet switched network when there is no access to packet switch 
transmission control data, and it is unknown whether packet loss concealment is in effect. 
Thus, both manifestations of a dropped packet are detected using one test signal. The test 
signal of at least one sequence of N waveforms is designed so that either nulls or lost packets 
that are concealed will produce values in the received sequence that differ from the 
predetermined sequence of transmitted values. 

As embodied herein, and depicted in Figure 1, a hybrid telecommunications network 
in accordance with the present invention is disclosed. Figure 1 shows one example of how 
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the present invention may be employed. Test system 10 of the present invention is coupled to 
public switched telephone network (PSTN) 12. PSTN 12 is coupled to packet switched 
network 16 by gateway 14. PSTN 12' is coupled to packet switched network 16 by way of 
gateway 18. Test system 10' is coupled to PSTN 12'. In the example shown in Figure 1, 
system 10 initiates a call to system 10' by way of circuit switched PSTN 12. PSTN 12 routes 
the call to gateway 14. Gateway 14 converts time division multiplexed (TDM) signals into 
packets that are compatible with packet switched network 16. Gateway 14 has access to a 
directory of IP addresses of exit gateways. Gateway 14 uses the directory to select gateway 
18. Packet switched network 16 transports the packets to gateway 18. Gateway 18 converts 
the packets back into a TDM format compatible with PSTN 12'. PSTN 12' routes the TDM 
signal to system 10'. Subsequently, test system 10 transmits a sequence of N test waveforms. 
System 10' receives the telephonic transmission via network 1, and determines if there are 
any dropped packets by processing the received waveforms to assign values associated with 
each waveform, and comparing the assigned values to a predetermined sequence of values. 
This arrangement provides a method for detecting dropped packets across a packet switched 
network without having access to packet transmission control data. 

Packet switched network 16 is commonly referred to as a converged network. A 
converged network is adapted to carry various types of media, such as voice, data, and audio 
or video streams. Each of these media types are digitized and formatted into discrete packets 
of data. Packet switched network 16 may be of any suitable type, but there is shown by way 
of example an Internet Protocol (IP) network adapted to carry packet-switched voice, or 
Voice over the Internet (VoIP). In one embodiment, network 16 is the public Internet which 
comprises the worldwide collection of interconnected networks that are linked together by the 
use of the Internet Protocol (IP). This worldwide collection of networks includes a host of 
networks sponsored by academic, commercial, governmental, and military entities. In 
another embodiment, packet switched network 16 may include a packet switched network, or 
a collection of packet switched networks interconnected by a common protocol, not 
connected to the Internet. An example of such a network would be a privately owned 
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intranet, or enterprise network. In yet another embodiment, network 16 may include both 
enterprise networks, intranets, and the public Internet. 

As embodied herein and depicted in Figure 2, a detailed diagram of test system 10 is 
disclosed. System 10 is coupled to network 1 by way of telephone- line interface 42. 
5 Telephone-line interface 42 is bi-directionally coupled to codec 40. On the transmit side, a 
stored waveform is retrieved from memory (either RAM 102 or ROM 104) and provided to 
codec 40 via system bus 110. Codec 40 encodes the digitized sequence of N waveforms 
retrieved from memory into an analog signal suitable for insertion to the PSTN via a standard 
access loop. The encoded analog signal is provided to interface circuit 42 via the bi- 
10 directional connection, and transmitted over network 1. Each transmitted waveform is of a 
5 duration that matches the payload of a packet generated in a packet switched network 16 (See 

no 

*S Figure 1). Thus, each transmitted waveform operates to assign a value to a packet carrying 

O 

y, the transmitted waveform. Test system 10 also may function as a standard POTS telephone 

hi 

set. In this mode, A/D converter receives voice generated analog signals from telephone 
jjj 15 headset microphone circuit 34. 

flj Analog telephonic transmissions from network 1 are received from interface circuit 42 

p-j and provided to codec 40, which creates PCM encoded digital images of the analog signal 

1 y that is stored in a file in RAM 102. The file includes a digital representation of each of the 

received waveforms. Processor 100 is programmed to process the stored file to extract the 
20 appropriate waveform characteristic for each of the N transmitted waveforms that are 

received. In one embodiment, processor 100 is programmed to determine the average peak 
power of each received waveform. The average peak power is converted to a numerical value 
representing its rank among the average peak powers calculated for the N received 
waveforms, thereby creating a sequence of received values. The sequence of received values 
25 is compared to the sequence of values representing the analogous ranks of the average peak 
powers among the transmitted set of N waveforms. Since each transmitted waveform 
operates to assign a value to a packet carrying the transmitted waveform, the sequence of 
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received values indicates which packets successfully traversed the packet switched network 
16. 

The overall control of system 10 is provided by microprocessor 100. Microprocessor 
100 is coupled to RAM 102, ROM 104, secondary memory 106 and I/O circuit 108, by 
5 system bus 110. System bus 110 provides the necessary data, address, and control lines. 
Codec 40 is also coupled to microprocessor 100 by system bus 110. 

Telephone line interface 42 may be of any suitable type, but by way of example, 
interface 12 includes an integrated circuit, such as a Motorola MC3401OP, coupled to 
isolation transformers. The isolation transformers prevent grounding problems. One of 
l a : 10 ordinary skill in the art will recognize that the functional block depicted by interface 42 also 

□ includes DTMF capabilities. 

CD 

42 PCM codec transceiver 40 uses a standard digitization scheme to band limit voice 

n 

r: frequencies to the 300 - 3300Hz frequency band. Codec 40 performs an A/D conversion of 

an analog signals using a PCM digitization scheme. In one embodiment for example, the 



Q 15 PCM digitization results in a mu-law companded 64 kbps signal wherein larger amplitudes 

ru 

pj are compressed relative to the smaller amplitudes, providing an equivalent 12-bit accuracy 

pj within an 8-bit digital word carrying the values of amplitude sampled at the rate of 8000Hz. 

Hi In one embodiment, codec 40 includes a semiconductor IC manufactured by SGS Thompson 

or by the National Semiconductor Company having the product number ETC5056, or 
20 equivalent. 

Read/write random access memory (RAM) 102 is used in data processing and data 
I/O. Read only memory (ROM) 104 is used to store the system 10 programming instructions 
used by processor 100. Those of ordinary skill in the art will recognize that ROM 104 can be 
implemented using DRAM, ROM, PROM, or EEPROM. The secondary memory 106 may 
25 be implemented using a hard drive, floppy diskettes, CD-ROM, or any other suitable 

computer readable medium. Programming instructions, waveform generation data, value 
sequences, and other data associated with the transmission and reception of the various sets of 
waveforms can be stored using ROM 104 or secondary memory 106. 
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In one embodiment, processor 100 is implemented using an off-the-shelf 
microprocessor such as a Pentium processor manufactured by Intel. Those of ordinary skill 
in the art will also recognize that processor 100 can also be implemented using application 
specific integrated circuits (ASIC), or a combination of off-the-shelf processors and ASICs in 
5 the design. Signal processor 200 may be implemented using any suitable signal processing 
device such as a digital signal processor (DSP) manufactured by Motorola, or by some other 
manufacturer. 

In one embodiment, I/O circuit 108 supports a computer interface, a display such as a 
LCD device, and a user interface. The computer interface is adapted to communicate with an 
10 external computing device. For example, programming instructions or waveform set data 

O stored in memory 104 can be completely replaced or partially replaced with new instructions 

09 

£ down loaded from the external computing device. One of ordinary skill in the art will 

GJ 

y, recognize that data flow is bi-directional. Processor 100 may transfer waveform data or 

^ telephonic transmission data to an external device for further processing and/or statistical 
O 1 5 analysis. The user interface may be of any suitable type, but there is included by way of 

nj example a telephone set twelve-key dialing device, a function key set, and a keyboard for 

Si 

data entry and programming functions. 
~ H? " ^~--^__^^'Figure 3 is a chart showing a method for determining dropped packets in accordance 
with another embodiment of the present invention. In step 400, a telephonic connection is 
20 established between test system 10 and test system 10'. After retrieving the set of N 

waveforms from memory, test system 10 is configured to transmit the set of N waveforms 
over the telecommunications network (N is an integer number). Each waveform possesses a 
different characteristic operant to distinguish it from the other waveforms in the set of N. The 
characteristic may be average signal power, peak power, frequency, a number of phase 
25 changes per waveform segment, a CELP waveform symbol, a bit-pattern reflected in a 
semantically encoded waveform, or any other suitable means of encoding a distinctive 
characteristic in a waveform. The set of N waveforms transmitted by system 10 thereby 
represents a predetermined sequence of values (1,... , N) that index the expected order of the 
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distinguishing characteristics of the N waveforms received and recorded by test system 10'. 
In one embodiment, each waveform in the set of N includes two waveform segments. The 
first segment is a sinusoidal wave transmitted at a minimum peak-power level close to a noise 
floor. The second segment is a sinusoidal wave transmitted at one of N equally spaced power 
5 levels between the minimum peak-power level and a maximum peak power level. Thus, the 
peak power of the second segment functions as the representative waveform characteristic of 
the transmitted waveform. In the case where N = 4, four two-portion waveforms are 
concatenated and transmitted by system 10 over the telephonic connection. Thus, the 
transmitted set of N waveforms represents a predetermined sequence of values (1, 2, 3, 4) 
fc!; 10 corresponding to the relative magnitudes of peak power levels of the second segment of each 

Q waveform transmitted in sequence. Starting at step 406, the transmission received at test 

ggj 

i§ system 10' is processed to produce a corresponding received sequence of values that reveals 

Ll the occurrence of dropped packets. Test system 10' receives the transmission from system 

ls? " 10. The transmission is digitized and stored in memory. During post processing, the 

O 15 received transmission is divided into waveform sections having a duration substantially equal 

ru 

Hj to each of the transmitted waveforms, i.e., the duration of a voice sample in a packet 

fA transmitted across packet switched network 16. A value is assigned to each waveform based 

^ on the relative magnitude of the maximum value of average peak power measured over small 

subdivisions of each waveform. This produces an integer sequence of values associated with 
20 the received set of N waveforms that are then compared to the predetermined sequence of 
values encoded by the transmitted set of N waveforms. Deviations from the predetermined 
sequence of values then reveal dropped packets. If a value in the sequence is zero, the 
receiver recognizes that the packet carrying the expected predetermined value was dropped 
without concealment. If the section sequence includes a repeated value, e.g., 1, 2, 2, 4, the 
25 receiver recognizes that the packet carrying value 3 was dropped and concealed. 

It will be apparent to those of ordinary skill in the pertinent art that modifications and 
variations can be made to the technique used to encode a predetermined value into a 
transmitted waveform, depending on the design of both the transmission test sub-system 30 
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and the receiver test sub-system 20. For example, a value may be encoded in the second 
segment of a waveform by the number of phase shifts in the second segment. In another 
embodiment, the value corresponds to the frequency of the transmitted sinusoid. 

In yet another embodiment, CELP (Code Excited Linear Prediction) coding is used to 
encode each predetermined value. CELP coding employs a library, or a table, of waveform 
symbols. Each waveform symbol has a numerical or alphabetical designation, e.g., symbol 1, 
symbol 2, symbol 3, and etcetera. On the receive side, processor 100 employs a look-up table 
to decipher each received CELP waveform. Thus, transmission of waveform symbol 1 , 
waveform symbol 2, waveform symbol 3, and waveform symbol 4 correspond to the 
predetermined sequence 1, 2, 3, and 4. If a waveform symbol is not present at its expected 
location within the transmission, the packet carrying the missing symbol was dropped. 

In yet another embodiment, semantically encoded waveforms are used to encode the 
predetermined sequence of values. A waveform having semantic content is transmitted by 
retrieving a predetermined bit pattern retrieved from memory(RAM 102 or ROM 104) and 
generating waveforms encoding that bit pattern in accordance with a predetermined data 
modulation scheme that is fed into codec 40. On the receive side, codec 40 decompresses 
and decodes the received signal to obtain a bit-pattern. The bit pattern is stored in a file and 
read by microprocessor 100 during post processing. In this case, the predetermined sequence 
of values corresponds to a predetermined sequence of bit-patterns which are easily read by 
microprocessor 100. Reference is made to U.S. Patent No. 5,748,876, which is incorporated 
herein by reference as though fully set forth in its entirety, for a more detailed explanation of 
semantically encoded waveforms. 

In all of the above described embodiments, a received telephonic signal is compared 
to a predetermined sequence of values to detect dropped packets in a packet switched 
network, without having access to packet switched network transmission control data. 

It will be apparent to those skilled in the art that various modifications and variations 
can be made to the present invention without departing from the spirit and scope of the 
invention. Thus, it is intended that the present invention cover the modifications and 
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variations of this invention provided they come within the scope of the appended claims and 
their equivalents. 
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